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ABSTRACT 


The  empirical  power  of  a  new  multivariate  goodness-of- 
fit  test  proposed  by  Foutz  (1980)  is  investigated.  The 
test  has  been  applied  to  Monte  Carlo  samples  from  bivariate 
and  trivariate  normal  distributions  with  a  variety  of  mean 
vectors  and  covariance  matrices.  The  null  hypothesis 
tested  is  that  the  sample  is  from  a  multivariate  normal 
distribution  with  £  mean  vector  and  covariance  matrix  the 
identity  I.  The  observed  number  of  rejections  in  5000 
replications  is  used  as  the  measure  of  effectiveness  of 
the  test.  The  results  indicate  that  the  Foutz  test  is 
quite  capable  of  detecting  mean  and  variance  shifts  but 
is  not  as  powerful  against  covariance  shifts. 
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I.  INTRODUCTION 


In  statistical  analysis,  choosing  the  correct  distri¬ 
bution  to  model  available  data  is  of  importance.  A  class 
of  procedures  known  as  goodness-of-f it  tests  has  been 
derived  to  test  the  hypothesis  that  a  set  of  samples  is 
from  a  given  distribution.  Many  of  these  tests  are 
readily  available  and  are  well  known,  such  as  the  Chi- 
square  or  the  Kolmogorov-Smirnof f  (K.S.)  goodness-of-fit 
test.  These  tests  were  designed  for  univariate  distri¬ 
butions  and  are  not  usable  as  multivariate  goodness-of-fit 
tests  in  their  present  form. 

In  1980  Robert  V.  Foutz  [Ref.  1]  proposed  a  new  multi¬ 
variate  goodness-of-fit  test  that  will  be  called  the  Fn 
test  in  the  sequel.  In  analogy  to  the  K.S.  test  the  Fn 
test  compares  a  hypothesized  cumulative  distribution  func¬ 
tion  (CtiF)  with  a  "continuous  empirical  distribution 
function"  (CEDF)  formed  from  sampled  data.  Foutz  found 
the  null  distribution  of  the  test  to  be  distribution  free 
as  well  as  being  independent  of  the  number  of  variates  p. 

Foutz  obtained  an  integral  expression  for  the  null 
distribution  of  the  Fn  test  statistic,  and  closed  form 
solutions  for  sample  size  2  or  3  were  provided.  The 
complexity  of  the  integral  expression  increases  with 
sample  size,  and  a  normal  approximation  to  the  null  distri¬ 
bution  was  given  for  use  with  larger  sample  sizes.  Although 
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the  Fn  test  was  designed  as  a  multivariate  goodness-of-fit 
test  it  can  also  be  used  to  fit  univariate  distributions. 
Franke  and  Jayachandran  [Ref.  2]  compared  the  empirical 
power  of  the  Fn  test  with  that  for  the  Chi-square  test  and 
the  K.S.  test.  The  results  indicated  that  the  Fn  test 
competes  well  with  these  other  tests. 

The  power  of  the  Fn  test  as  a  multivariate  goodness-of- 
fit  test  is  investigated  in  this  thesis.  A  description  of 
the  Foutz  test  is  given  in  Section  II  and  the  Monte  Carlo 
methods  of  simulation  are  presented  in  Section  III.  The 
results  and  conclusions  are  in  Section  IV.  A  Fortran  code 
for  the  application  of  the  Fn  test  is  available  in  the 
Appendix . 
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II.  THE  FOUTZ  TEST 

The  Fn  test  for  multivariate  goodness-of-fit  is  based  on 
a  comparison  of  a  hypothesized  CDF  with  a  continuous  empiri¬ 
cal  distribution  function  (CEDF)  derived  from  a  sample.  The 
first  step  in  the  determination  of  the  CEDF  is  the  construction 
of  what  are  known  as  statistically  equivalent  blocks.  A 
general  method  for  determining  statistically  equivalent  blocks, 
due  to  Anderson  [Ref.  3] ,  is  described  below. 

Given  a  random  sample  2' *  *  * '— n-1  ^rom  a  p-variate  con¬ 
tinuous  distribution,  select  n-1  functions  h^(X),  k  =  1,2,..., 
n-1,  not  necessarily  distinct,  such  that  each  h^Cx)  has  a 
continuous  distribution.  These  functions  are  referred  to  as 
cutting  functions  and  will  be  used  to  partition  the  sample 
space  into  blocks.  Let  k^,k2,...,k  ^  be  a  permutation  of 

1,2,..., n-1.  Order  the  X.'s  according  to  h,  (X)  and  define 

1  K1 

X(k^)  as  the  k^th  order  statistic.  The  sample  space  is  par¬ 
titioned  into  two  blocks . 


B 


1  I 

B_  =  f  X:  h 

2  I 


^  X:  hy.  (X)  <  hk  (X(kL)) 


v  (x)  >  h.  (x(k.))  . 

*l  *i  1 


At  the  second  step  if  0  <  k^  <  k^  the  k-1  X's  in  B^  are 
ordered  according  to  hk  (X) ;  X(k2)  is  defined  as  the  k2th  in 
the  ordering.  Define  a  cut  on  B^  obtaining  3  blocks  as  follows: 


! 


r—r  -v 
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BU  ■  B1  n  !  S‘  \<5>  i  hk2(X(k2)) 


I 


B12  =  B1  n  j  hk2(-}  >  hk2(-(k2})j  ' 


B20  *  B2 ‘ 


Now  consider  the  other  alternative,  k2  >  k^ .  We  rank  the 

((n-D-k^)  X's  in  the  second  block  B2  according  to  h^  (X) 

and  let  X(k2)  be  the  (k2~k^)th  largest  in  the  ranking.  De^ 

fining  a  cut  at  h.  (X(k,))  we  obtain  the  3  blocks, 

*2  ~  2 


B10  “  Bl' 


B21  B2 


n  j  X: 

I  2 

i 


\  (X)  -  hk2(X(k2)  5  j 


! , 


a22  =  »2«  jx,  h^lx)  >  hk2(x(k2)) 


!  . 


The  process  is  continued  until  all  the  cutting  functions  are 
exhausted.  This  results  in  a  partition  of  the  sample  space 
into  n  statistically  equivalent  blocks,  which  are  denoted  by 
8^,  i  =  1 , . . . ,n. 

In  the  univariate  case  an  intuitively  appealing  choice  for 
the  cutting  functions  is  the  identity  function  viz.,  h(X)  =  X 
for  all  k.  The  resulting  statistically  equivalent  blocks  are 
then  (-<*>, X(l)],  (X(l)  ,X(2)]  ,  . . . ,  (X(n-l)  ,+<»)  where  X(j)  is  the 
jth  order  statistic.  The  multivariate  analogue  is  to  choose 
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individual  coordinates  as  cutting  functions,  viz.,  h^fX)  »  x^ 
the  jth  coordinate  of  X.  An  example  illustrating  the  con¬ 
struction  of  the  blocks  in  the  bivariate  case  is  given  below 
for  a  sample  of  size  8. 

Let  (2, 4, 6, 8, 1,3, 5, 7)  be  the  permutation  vector  K.  Define 

hk(X)  =  X^  ,  the  first  coordinate  of  X,  for  k  *  2,4,6, 8  and 
12) 

h^(X)  =  X  ,  the  second  coordinate,  for  k  =  1,3, 5, 7.  Figure  1 
gives  a  graphical  representation  of  the  rectangular  coordinate 
method  of  forming  blocks  and  Figure  2  is  the  representation 
for  the  polar  coordinate  method.  The  random  sample  that  was 
used  in  both  figures  is  found  in  Table  I . 


TABLE  I:  SAMPLE  BIVARIATE  DATA 


N  =  8 


Observation 

Coordinate 

1  2 

3 

4 

5  6 

7 

8 

1 

-3.54  2.25 

-1.00 

.71 

2.00  -  .75 

-2.25 

0.00 

2 

0.00  -2.25 

0.50 

.00 

1.25  -1.50 

-1.50 

-0.50 

The  first  element  of  the  permutation  vector  is  k  *  2  and 
h2  (X )  =  X(1)  ,  therefore  is  defined  to  be  the  second 

smallest  first  coordinate.  This  partitions  the  sample  space 
into  two  blocks, 


B 


1 


B 


2 


( 

I 


X: 


x<D 


; 


12 


Xx  AXIS 


FIGURE  1:  STATISTICALLY  EQUIVALENT  BLOCKS — 
RECTANGULAR  COORDINATES 
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FIGURE  2:  STATISTICALLY  EQUIVALENT  BLOCKS 
POLAR  COORDINATES 


The  second  element  of  the  permutation  vector  is  k2  s  4, 
h4(X)  *  X(1)  and  k2  >  Hence  the  block  B2  is  partitioned 

into  two  sub-blocks. 


B 


21 


B 


22 


X(1> 


9 


X(D 


> 


9 


where  X2^  is  the  second  largest  coordinate  among  the  X's  in 
block  B2 .  At  this  stage  the  sample  space  is  partitioned  into 
three  blocks.  Next,  the  third  element  of  the  permutation 
vector  and  the  corresponding  cutting  function  define  another 
partition  of  one  of  the  three  blocks  into  two  sub-blocks. 

This  process  is  continued  until  the  permutation  vector  is 
exhausted,  at  which  stage  the  sample  space  will  be  partitioned 
into  9  statistically  equivalent  blocks. 

The  CEDF  is  now  constructed  by  spreading  a  mass  1/n  within 
each  block.  If  HQ  is  the  hypothesized  CDF  and  Hn  the  CEDF, 
the  test  statistic  Fn  takes  the  form 


Fn  =  SUP  |Hn(X)  -  Hq(X) | .  (1) 

X 

Let  D^,  i  =  be  the  probability  contents  of  the 

blocks  8^  under  the  null  hypothesis  HQ,  i.e.,  Di  «  /  dHQ(x). 

®i 

A  computational  form  of  the  Foutz  test  statistic  is, 
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Fn 


l  Max  (0,± 
i*l  n 


Di) 


(2) 


Foutz  gave  the  following  representation  for  the  cumulative 
distribution  of  the  test  statistic 


P (Fn <  x) 


V51 


. ,  d6 


n-l‘ 


(3) 


where 


gn(6l'62'*"'6n-l)  =  n!  (n-1)  ! 


for 


i  >  6,  >  (5,-6,)  >  ...  >  (6n_x-6 


n  —  1 


2  U1 


'n-l'  >  -4n-l' 


The  evaluation  of  this  integral  is  cumbersome  and  has  not  been 
carried  out  for  n  >  5 .  Foutz  has  therefore  derived  a  large 
sample  normal  approximation  given  by 


Lim  P[Fn<_x ] 
n-«*> 


*[■ 


n^tx-e'1) 


( 2e-1  -  5e 


-ri/21  • 


(4) 


To  check  the  accuracy  of  the  normal  approximation,  Franks 
and  Jayachandran  [Ref.  4]  generated  80,000  samples  of  sizes 
20,  30  and  50.  Table  II  contains  the  empirical  significance 
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TABLE  II:  EMPIRICAL  SIGNIFICANCE  LEVEL  OF  THE  FOUTZ  Fn  TEST 


Sample  Size 

20 

30 

50 

Normal 

Significance 

Level 

.10 

.0757 

.0800 

.0859 

.05 

.0372 

.0399 

.0428 

.01 

.0082 

.0083 

.0093 

levels,  when  the  normal 

approximation 

was  used 

to  determine 

the  critical  values  for 

the  Fn  test. 

It  is  clear  that  the 

rejection  rates  given 

in  Table  II 

are  consistently  lower  than  the  nominal  values. 

More  accu- 

rate  critical  values  were  therefore  determined 

from  the 

80,000  Fn  values  and  are 

presented  in 

Table  III 

• 

TABLE  III:  APPROXIMATE  CRITICAL 

VALUES  FOR 

Fn  TEST 

Sample  Size 

20 

30 

50 

Significance  Level 

.10 

.42714 
( .43386) 

.41903 
(  .42383) 

.40816 

(.41150) 

.05 

.44865 
( .45513) 

.43553 

(.43969) 

.42116 

(.42386) 

.01 

.48659 
( .49127) 

.46579 

(.46944) 

.44487 

(.44706) 

Values  in  parentheses  are  those  obtained  from  the  normal 

approximation  given  by  Foutz . 
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III.  DESCRIPTION  OF  THE  SIMULATION 


In  order  to  check  the  efficacy  of  the  Foutz  test  as  a 
multivariate  goodness-of-f it  test  a  simulation  was  run  to 
generate  sample  data  from  various  bivariate  and  trivariate 
normal  distributions.  The  hypothesis  tested  in  each  case 
is  that  the  sample  is  from  a  multivariate  normal  distribu¬ 
tion  with  mean  vector  £  and  covariance  matrix  the  identity 
£.  Rectangular  and  the  polar/spherical  method  of  blocking 
were  both  used  and  compared  as  to  their  effect  in  each 
case. 

To  validate  the  blocking  schemes,  the  null  hypothesis 
is  tested  against  data  generated  from  the  distribution 
N(0,£).  Bivariate  and  trivariate  sample  sizes  of  20,  30 
and  50  are  used  to  compute  the  Fn  statistic  which  is  then 
compared  to  the  empirical  critical  levels  found  in  Table  III. 
Rejection  rates  are  based  on  the  number  of  rejections  in 
20,000  replications  for  each  sample  size.  Comparing  the 
null  rejection  rates  to  the  nominal  significance  level 
used,  as  shown  in  Table  III,  provides  evidence  supporting 
both  blocking  methods  as  all  null  rejection  rates  are  close 
to  the  significance  level  used. 

The  empirical  power  of  the  test  was  then  investigated 
by  varying  the  distribution  tested.  This  investigation  is 
accomplished  in  three  different  ways.  First,  the  mean  is 
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shifted  away  from  the  0  vector  while  leaving  the  covariance  as 
the  identity  matrix.  This  is  done  to  investigate  the  ability 
of  the  test  to  detect  location  shifts.  The  covariance  matrix 
is  then  changed  from  the  identity  while  leaving  the  mean  as 
the  0  vector.  This  is  accomplished  by  changing  the  diagonal 
elements  alone  to  investigate  variance  shifts  and  then  shift¬ 
ing  the  off  diagonal  elements  by  themselves  to  check  the  effect 
of  covariance  shifts.  A  primary  sample  size  of  20  was  chosen 
for  comparison  and  5000  replications  were  used  to  compute 
rejection  rates  for  each  distribution  tested.  Mixing  of  the 
three  types  of  shifts  is  also  simulated  to  investigate  the 
possible  confounding  effects  of  the  three  shifts.  Finally 
sample  sizes  of  30  and  50  are  run  on  a  few  of  the  distribu¬ 
tions  to  determine  the  effect  of  increasing  the  sample  size. 

The  various  multivariate  normal  distributions  are  simulated 
in  the  following  manner.  Univariate  normal (0,1)  pseudorandom 
deviates  are  obtained  from  the  LLRANDU  series  by  Lewis  [Ref.  5] 
and  grouped  to  form  a  multivariate  N(0,I)  p-variate  vector. 
Taking  the  so  formed,  the  p-variate  N(£,I)  vector  random 
variable  is  transformed  by 

c“1X*+  u  *  X  ,  (1) 


where 


C'  E  C  -  I, 
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resulting  in  an  X  which  is  distributed  as  N(u,Z_)  .  The  Foutz 
test  is  then  applied  to  each  of  the  samples  consisting  of 
(n-1)  xs. 

An  example  using  a  bivariate  sample  helps  illustrate  the 
blocking  procedure  used.  Let  X^,X2, . . . ,Xn_^,  be  the  simu¬ 
lated  bivariate  sample.  The  first  cut  is  made  on  X^^  or 
the  first  coordinate  of  the  first  vector  X^.  Two  blocks  are 
formed. 


First 

Second 

Coordinate 

Coordinate 

B1  * 

(-«,x{1)] 

(-00  , +00) 

B2  - 

(x[1) ,+*) 

(-0°,+°°)  • 

X2  is  taken  next 

and  determined 

to  be  contained  in  block  B^ 

or  B2 . 

Suppose 

X2  is  in  block  B 

2.  B2  is  then  partitioned 

^  x‘2> 

or  the  second  coordinate 

of  sample  X2 .  Three  blocks 

are  now 

defined 

as, 

First 

Second 

Coordinate 

Coordinate 

B10  = 

<  — x'11] 

(-00  ,  +00) 

B21  * 

(x{1} ,+«) 

B22 

(x{1} ,+-) 

20 


This  procedure  is  continued  by  examining  the  next  vector 
in  the  random  sample,  locating  the  block  that  it  is  contained 
in  and  partitioning  the  block  by  the  designated  coordinate. 

The  coordinate  cutting  functions  used  are  alternated  starting 
with  the  first  coordinate  for  the  first  cut.  Coordinate 
ranges,  as  shown,  are  used  to  designate  blocks  and  the  process 
is  continued  until  n  blocks  are  so  defined.  Given  any  random 
sample  this  method  can  be  shown  to  be  equivalent  to  a  unique 
permutation  vector  K  and  a  set  of  cutting  functions  {h^}  as 
defined  in  Section  II. 

After  the  formation  of  the  statistically  equivalent  blocks, 
each  block  has  the  probability  content  of  1/n  and  must  be 
compared  to  the  hypothesized  content  using  the  statistic 

n  l 

Fn  =  ^  max[0,i-DiJ  .  (2) 

,  the  probability  content  of  each  block,  under  the  null 
hypothesis,  is  defined  by  the  integral  of  the  null  density 
over  the  block.  The  integral  of  the  multivariate  normal  (0,1) 
over  a  rectangular  block  yields 

-P 

Di  m  J  ...  /  (2tt)"*~  e” ^1/2^  — dx.  (3) 

®i 
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This  reduces  to  the  product  of  the  marginal  densities  which 
may  be  easily  evaluated  with  many  available  routines,  elimi¬ 
nating  the  need  for  numerical  integration. 

In  spherical  coordinates  is  represented  by 


Di 


III  2tt  (_3/2)  e(“1/2)p  sin(<J>)p 2  dpd6d<f>. 
4>i  Pj_ 

(4) 


Upon  separation. 


Di 


(1/2)  sin  <j>  d<f> 


/  (2TT)-1de 


2p2e(‘1/2)p 
- T7T- 


(2ir ) 


2 

dp 


(5) 


Noting  that  with  a  change  of  variables  the  third  integrand 
is  a  Chi-square  density  with  3  degrees  of  freedom,  we  may 
use  a  closed  form  expression  to  evaluate  D  as  follows: 


Di 


[ 2  (cos  $2  ~  cos  <5 ^ )  3  *  [2^  (9 2” ®  1  ^  ^ x  ^3df  ^2^  3df  ^ p  1^ 


(6) 


where 

*3df^pi*  *  P^*3df-Pi^'  *  =  1,2> 

For  bivariate  data  the  use  of  polar  coordinates  leads  to 
similar  simplification  leaving  0^  in  the  form 
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(7) 


Di  =  2tt(92“01)  *  [x2df(R2^  “  ^x2df(Rl^‘ 

After  the  calculation  of  the  probability  contents  for 
the  n  blocks,  equation  (2)  is  used  to  evaluate  the  Fn  statis¬ 
tic  for  each  generated  sample.  The  statistic  is  then  compared 
to  the  critical  values  found  in  Table  III  to  decide  if  the 
null  hypothesis  is  accepted  or  rejected.  Rejection  rates 
are  defined  by  the  number  of  rejections  divided  by  the  number 
of  replications  in  a  given  run.  The  rejection  rates  thereby 
define  an  empirical  power  for  the  simulated  distribution. 

The  major  component  of  the  Fortran  simulation  program 
used  to  evaluate  the  Foutz  statistic  for  a  given  sample  is 
available  in  the  Appendix.  It  has  been  adapted  for  use  for 
sample  sizes  up  to  50,  with  redimensioning  being  needed  for 
larger  sample  sizes.  The  program  is  applicable  for  fitting 
data  from  any  hypothesized  multivariate  normal  distribution 
and  provides  the  Fn  statistic  as  computed  by  both  blocking 
methods  presented.  The  code  is  self-contained  except  for 
three  IMSL  routines,  LUDECP,  MDNOR,  and  MDCH  [Ref.  6].  These 
subroutines  provide  matrix  decomposition,  univariate  normal 
probabilities  and  chi-square  probabilities,  respectively, 
and  must  be  available  or  substituted  prior  to  utilization 
of  the  program. 
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IV.  RESULTS  AND  CONCLUSIONS 

The  results  of  the  simulation  are  summarized  in 
Tables  IV-XIV.  Rejection  rates  are  given  by  the  distribu¬ 
tion  tested  and  the  significance  level  used.  Empirical 
power  curves  are  presented  in  Figures  3-8.  Rejection  rates 
are  plotted  against  the  magnitude  of  the  shift  in  mean, 
variance  and  covariance  for  the  distribution  tested.  All 
power  curves  are  based  on  5000  replicated  samples  and 
were  compared  at  the  a  =  .05  significance  level. 

The  results  for  the  case  in  which  the  distribution  of 
the  samples  is  the  same  as  the  hypothesized  distribution 
viz.,  N  ( () ,  Ij  are  given  in  Tables  IV  and  v.  The  rejection 
levels  obtained  are  close  to  the  nominal  significance 
level  for  both  blocking  methods.  No  distinct  pattern  of 
variation  about  the  prescribed  levels  is  discernible  for 
either  method,  as  expected. 

The  rejection  rates  for  mean  shifts  are  given  in  Tables 
VI-VII  and  Figures  3-4.  Shifts  in  the  mean  vector  are 
detected  well;  a  shift  of  one  standard  deviation  in  a 
single  coordinate  resulted  in  a  60%  rejection  rate  for 
bivariate  or  trivariate  data.  Greater  shifts  in  mean  led 
to  even  higher  rejection  rates.  The  rectangular  method 
of  blocking  consistently  gave  about  a  10%  improvement  over 
the  polar/spherical  method  in  detecting  mean  shifts. 
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Results  for  variance  shifts  are  contained  in  Tables 
VIII  and  IX  and  the  power  curves  are  given  in  Figures  5 
and  6.  The  Foutz  test  did  not  detect  small  variance 
shifts  very  well  but  the  performance  of  the  test  was  far 
better  for  larger  shifts  or  shifts  in  more  than  one  coor¬ 
dinate.  No  one  method  of  blocking  performed  better  in  all 
cases  but  in  general  the  polar/spherical  method  seemed  to 
outperform  the  rectangular  method  for  detecting  variance 
shifts. 

The  results  for  changes  in  covariance  are  summarized 
in  Tables  X,  XI  and  Figure  7.  Covariance  shifts  are  not 
detected  well  for  either  blocking  method  except  for  highly 
correlated  data  with  the  correlation  coefficient  equal  to 
.9.  The  polar/spherical  coordinate  blocking  method  appeared 
to  perform  a  little  better  than  the  rectangular  coordinate 
method  of  blocking,  but  in  general  the  simulation  revealed 
that  the  Fn  test  is  not  very  powerful  against  covariance 
shifts . 

The  empirical  power  for  combinations  of  shifts  in  mean 
and  variance  or  covariance  are  presented  in  Tables  XII  and 
XIII.  Entries  are  based  on  an  i  =  .05  significance  level 
and  are  tabled  by  the  mean  vector  and  covariance  matrix 
of  the  sample  data.  Entries  farther  down  and  to  the  right 
correspond  to  greater  shifts  in  mean  and  variance/covariance 
and  are  generally  larger,  as  is  to  be  expected.  There  are 
no  apparent  confounding  problems  due  to  shifts  in  both 
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parameters.  The  rectangular  method  of  blocking,  however, 
did  outperform  the  polar/ spherical  method  for  most  cases 
of  multiple  shifts. 

The  results  indicative  of  the  effect  of  increasing  the 
sample  size  are  summarized  in  Tables  XIV  and  XV.  Results 
for  sample  sizes  of  20,  30,  and  50  are  given  for  some 
representative  cases.  The  tables  reveal  higher  rejection 
rates  for  larger  sample  sizes  with  increases  being  compa¬ 
rable  for  both  blocking  methods. 

This  study  was  limited  to  the  two  and  three  variate 
normal  distribution.  There  are  many  problems  for  further 
research.  Of  primary  concern  is  the  generation  of  percen¬ 
tage  points  of  Fn  for  various  values  of  n.  The  intracta¬ 
bility  of  the  problem  of  obtaining  the  exact  distribution 
requires  an  empirical  approach  to  finding  a  correction  to 
the  asymptotic  approximation  given  by  Foutz.  Since  the 
use  of  coordinates  as  cutting  functions  worked  well,  the 
method  should  be  tried  for  other  distributions  and  higher 
dimensions . 

In  conclusion,  the  Fn  test  is  found  to  be  a  viable 
option  for  testing  goodness-of-f it  of  multivariate  normal 
distributions.  These  encouraging  empirical  results  indicate 
further  study  should  be  conducted  to  explore  the  potential 
of  this  test  for  other  distributions. 


TABLE  IV:  NULL  EMPIRICAL  REJECTION  LEVELS  FOR 
THE  BIVARIATE  NORMAL  DISTRIBUTION 


Significance  Level 
Blocking  Method 

.01 

.05 

.10 

N  =  20 

Rectangular 

.0098 

.0488 

.0940 

Polar 

.0096 

.0482 

.1020 

N  =  30 

Rectangular 

.0110 

.0510 

.0944 

Polar 

.0082 

.0454 

.0890 

N  =  50 

Rectangular 

.0120 

.0498 

.0950 

Polar 

.0098 

.0484 

.0958 

BASED  ON  20,000  REPLICATIONS 


TABLE  V:  NULL  EMPIRICAL  REJECTION  LEVELS  FOR 
THE  TRIVARIATE  NORMAL  DISTRIBUTION 


Significance  Level 
Blocking  Method 

.01 

.05 

.10 

N  =  20 

Rectangular 

.0104 

.0440 

.0982 

Spherical 

.0120 

.0518 

.1048 

N  »  30 

Rectangular 

.0114 

.0480 

.0956 

Spherical 

.0140 

.0484 

.0914 

N  =  50 

Rectangular 

.0098 

.0484 

.0960 

Spherical 

.0088 

.0478 

.0914 

BASED  ON  20,000  REPLICATIONS 
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ION  RATE 


A 


FIGURE  3:  POWER  CURVES  FOR  SHIFTS  IN  MEAN 
(BIVARIATE) 


>  > 


‘ION  RATE  REJECTION  RATE 


A 

FIGURE  4:  POWER  CURVES  FOR  SHIFTS  IN  MEAN 
(TRIVARIATE) 


0 


TABLE  VI:  REJECTION  RATES  FOR  SHIFTS  IN  MEAN  (BIVARIATE) 


N  *  20 


Critical  Value 

Mean  Tested 

.01 

.05 

.10 

0 

.0094 

.0488 

.0998 

0 

.0102 

.0482 

.0996 

-.5 

.0566 

.1684 

.2816 

0 

.0346 

.1096 

.2138 

.5 

.0574 

.1710 

.2700 

0 

.0430 

.1388 

.2298 

-.5 

.1408 

.3164 

.4534 

-.5 

.1038 

.2592 

.3610 

.5 

.1294 

.3024 

.4406 

.5 

.1230 

.3164 

.4534 

-1 

.4357 

.6664 

.7834 

0 

.2340 

.4484 

.6046 

1 

.4464 

.6700 

.7842 

0 

.2444 

.6664 

.7834 

-1 

.8382 

.9418 

.9748 

-1 

.7780 

.9212 

.9610 

1 

.8428 

.9418 

.9718 

1 

.6930 

.9212 

.9610 

-2 

.9936 

.9980 

.9996 

0 

.9926 

.9990 

.9996 

2 

.  9948 

.9998 

1.0000 

0 

.  9762 

.9950 

.9980 

-2 

1.0000 

1.0000 

1.0000 

-2 

1.0000 

1.0000 

1.0000 

2 

1.0000 

1.0000 

1.0000 

2 

1.0000 

1.0000 

1.0000 

BASED  ON  5000  REPLICATIONS 

FIRST  ENTRY— RECTANGULAR 
SECOND  ENTRY— POLAR 


TABLE  VII:  REJECTION  RATES  FOR  SHIFTS  IN  MEAN  (TRIVARIATE) 


N  *  20 

Critical  Value  .01  .05  .10 

Mean  Tested 


0 

.0104 

.0440 

.0982 

0 

.0120 

.0518 

.1048 

0 

-.5 

.0492 

.1502 

.2474 

0 

.0216 

.0980 

.1632 

0 

.5 

.0480 

.1438 

.2484 

0 

.0280 

.1036 

.1874 

0 

-.5 

.1076 

.2704 

.3990 

-.5 

.0472 

.1516 

.2516 

0 

.5 

.0972 

.2424 

.3688 

.5 

.0658 

.1912 

.3046 

0 

-.5 

.1826 

.3788 

.5170 

-.5 

.0848 

.2198 

.3584 

-.5 

.5 

.1738 

.3642 

.4948 

.5 

.0848 

.2198 

.3584 

.5 

-1 

.3782 

.5984 

.7212 

0 

.1184 

.2942 

.4212 

0 

1 

.3728 

.5984 

.7212 

0 

.1174 

.2866 

.4234 

0 

-1 

.7392 

.8892 

.9410 

-1 

.3808 

.6020 

.7338 

0 

1 

.7400 

.8892 

.9410 

1 

.4670 

.6918 

.7934 

0 
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TABLE  VII  (Continued) 


Critical  Value 

Mean  Tested 

.01 

.05 

.10 

-2 

.9636 

.9872 

.9958 

0 

0 

.7772 

.9138 

.9916 

2 

.8992 

.9676 

.9832 

0 

0 

.  8486 

.9448 

.9736 

-1 

.9134 

.9778 

.9894 

-1 

-1 

.  7688 

.8744 

.9312 

1 

.9102 

.9746 

.9900 

1 

1 

.7936 

.9244 

.9598 

-2 

1.0000 

1.0000 

1.0000 

-2 

0 

.9984 

.9996 

1.0000 

2 

1.0000 

1.0000 

■- 

1.0000 

2 

0 

.9998 

1.0000 

1.0000 

-2 

1.0000 

1.0000 

1.0000 

-2 

-2 

1.0000 

1.0000 

1.0000 

2 

1.0000 

1.0000 

1.0000 

2 

2 

1.0000 

1.0000 

1.0000 

BASED  ON  5000  REPLICATIONS 

FIRST  ENTRY— RECTANGULAR 
SECOND  ENTRY— SPHERICAL 
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TABLE  VIII. 

REJECTION 

RATES  FOR  SHIFTS 

IN 

VARIANCE 

(BIVARIATE) 

N  = 

20 

Critical  Values 

.01 

.05 

.10 

Variance  Tested 

1 

0 

.0094 

.0488 

.0998 

0 

1 

.0102 

.0482 

.0996 

1 

0 

.1864 

.3786 

.5150 

0 

3 

.1578 

.3342 

.4640 

2 

0 

.2228 

.4292 

.5628 

0 

2 

.1714 

.3582 

.4928 

1 

0 

.4030 

.6322 

.7474 

0 

5 

.4286 

.6448 

.7574 

3 

0 

.5790 

.7666 

.8580 

0 

3 

.5338 

.7450 

.8368 

1 

0 

.5640 

.7608 

.8556 

0 

7 

.6312 

.8106 

.8856 

1 

0 

.7092 

.8618 

.9222 

0 

10 

.8088 

.9228 

.9600 

5 

0 

.8998 

.9664 

.9832 

0 

5 

.8998 

.9665 

.9804 

10 

0 

.  9956 

.9994 

.9998 

0 

10 

.9920 

.9978 

.9988 

BASED  ON  5000  REPLICATIONS 

FIRST  ENTRY— RECTANGULAR 
SECOND  ENTRY— POLAR 
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TABLE  IX.  REJECTION  RATES  FOR  SHIFTS  IN 
(TRI VARIATE) 


N  =  20 


Critical  Value  .01  .05 

Variance  Tested 


1 

0 

0 

.0104 

.0440 

0 

1 

0 

.0120 

.0518 

0 

0 

1 

3 

0 

0 

.  0924 

.2372 

0 

1 

0 

.1606 

.3438 

0 

0 

1 

2 

0 

0 

.1500 

.  3330 

0 

2 

0 

.0888 

.2208 

0 

0 

1 

5 

0 

0 

.  1940 

.  3832 

0 

1 

0 

.4146 

.6374 

0 

0 

1 

7 

0 

0 

.2708 

.5026 

0 

1 

0 

.6100 

.8032 

0 

0 

1 

2 

0 

0 

.2758 

.5012 

0 

2 

0 

.2510 

.4538 

0 

0 

2 

3 

0 

0 

.4140 

.6270 

0 

3 

0 

.  3240 

.5394 

0 

0 

1 

3 

0 

0 

.  6622 

.8372 

0 

3 

0 

.6752 

.8312 

0 

0 

3 

10 

0 

0 

.3716 

.5980 

0 

1 

0 

.  7880 

.9078 

0 

0 

1 

5 

0 

0 

.7558 

.  8896 

0 

5 

0 

.7256 

.  8660 

0 

0 

1 

5 

0 

0 

.  9390 

.9770 

0 

5 

0 

.9292 

.  9762 

0 

0 

5 

VARIANCE 


.10 


.0982 

.1048 


.3626 

.4736 


.4644 

.3308 


.5372 

.7550 


.6332 

.8792 


.6326 

.5814 


.7514 

.6566 


.9038 
.  8966 


.7186 

.9506 


.9346 

.9182 


.9872 

.9852 
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TABLE  IX  (Continued) 


N  =  20 


Critical 

Value 

.01 

.05 

Variance 

Tested 

10  0 

0 

.9572 

.9866 

0  10 

0 

.  9470 

.9832 

0  0 

0 

10  0 

0 

.  9972 

.9998 

0  10 

0 

.  9858 

.  9970 

0  0 

10 

BASED  ON  5000  REPLICATIONS 

FIRST  ENTRY- -RECTANGULAR 
SECOND  ENTRY— SPHERICAL 


.10 

.9950 

.9926 

1.0000 

.9994 


TABLE  X: 


REJECTION  RATES  FOR  SHIFTS  IN  COVARIANCE 
(BIVARIATE) 


N  =  20 


Critical  Value 

.01 

.05 

.10 

Covariance  Tested 

1 

0 

.0094 

.0488 

.0998 

0 

1 

.0102 

.0482 

.0996 

1 

-.3 

.0152 

.0558 

.1068 

-.3 

1 

.0126 

.0598 

.1274 

1 

.  3 

.0126 

.0576 

.1178 

.  3 

1 

.0136 

.0656 

.1258 

1 

-.6 

.0288 

.1008 

.1782 

-.6 

1 

.0514 

.1576 

.2560 

1 

.6 

.0250 

.0912 

.1702 

.6 

1 

.0648 

.1838 

.2984 

1 

-.9 

.1166 

.2996 

.4446 

-.9 

1 

.2378 

.2982 

.6162 

1 

.9 

.1122 

.2996 

.4446 

.9 

1 

.  2378 

.4710 

.6042 

BASED  ON  5000 

REPLICATIONS 

FIRST  ENTRY — RECTANGULAR 
SECOND  ENTRY  — POLAR 
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TABLE  XI:  REJECTION  RATES  FOR  SHIFTS  IN 
(TRIVARIATE) 


N  =  20 


Critical  Value  .01  .05 

Covariance  Tested 


1 

0 

0 

.0104 

.0440 

0 

1 

0 

.  0120 

.0518 

0 

0 

1 

.1 

0 

- .  3 

.0104 

.0540 

0 

1 

0 

.  0124 

.  0488 

-.3 

1 

1 

0 

.  3 

.0106 

.0468 

0 

1 

0 

.0124 

.0512 

.3 

0 

1 

1 

.3 

.3 

.0126 

.0560 

.3 

1 

.3 

.0162 

.0676 

.  3 

.3 

1 

1 

0 

-.6 

.0152 

.0740 

0 

1 

0 

.0122 

.0584 

-.6 

0 

1 

1 

0 

.  6 

.0148 

.0674 

0 

1 

0 

.  0128 

.0582 

.6 

0 

1 

1 

.  6 

.6 

.0308 

.1136 

.  6 

1 

.6 

.0432 

.1434 

.6 

.  6 

1 

1 

0 

-.9 

.0412 

.1358 

0 

1 

0 

.0254 

.0974 

-.9 

0 

1 

1 

0 

.9 

.0402 

.1386 

0 

1 

0 

.0258 

.1386 

.  9 

0 

1 

1 

.9 

.  9 

.1406 

.  3454 

.9 

1 

.9 

.  3646 

.5950 

.9 

.  9 

1 

BASED  ON  5000  REPLICATIONS 


FIRST  ENTRY— RECTANGULAR 
SECOND  ENTRY— SPHERICAL 


COVARIANCE 


.10 


.0982 

.1048 


.1076 

.1066 


.0972 

.1086 


.1112 

.1292 


.1394 

.1158 


.1298 

.1194 


.1960 

.2486 


.2314 

.1842 


.2368 

.2368 


.4942 

.7122 
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TABLE  XII:  REJECTION  RATES  FOR  MULTIPLE  SHIFTS 
IN  MEAN  AND  VARIANCE-COVARIANCE 
(BIVARIATE) 


N  =  20 


Sigma 

1  0 

0  1 

1  .6 

.6  1 

2  0 

0  2 

2  .849 

.  849  2 

5  1 

1.34 

Mean 

0 

.0488 

.0912 

.1986 

.2500 

.9658 

0 

.0482 

.1176 

.1522 

.2162 

.9572 

.5 

.1710 

.2398 

.3110 

.3702 

.9720 

0 

.1388 

.2482 

.2498 

.3402 

.9650 

1 

.5606 

.  7346 

.6384 

.6828 

.9820 

0 

.4348 

.5952 

.5334 

.6316 

.9764 

1 

.9418 

.8774 

.9350 

.8658 

.9892 

1 

.8576 

.8588 

.  8722 

.8308 

.9840 

2 

.  9998 

.9998 

.9902 

.9950 

.9990 

0 

.9950 

.9990 

.9772 

.9882 

.9964 

FIRST  ENTRY— RECTANGULAR 
SECOND  ENTRY— POLAR 

BASED  ON  5000  REPLICATIONS 
a  =  .05 
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TABLE  XIII:  REJECTION  RATES  FOR  MULTIPLE  SHIFTS 
IN  MEAN  AND  VARIANCE -COVARIANCE 
(TRIVARIATE) 


N  *  20 


10  0 

1  0  .6 

5  0  0 

10  0  .95 

5  0  0 

Sigma 

0  10 

0  0  1 

0  10 

.6  0  1 

0  10 

0  0  1 

0  10 
.95  0  1 

0  5  0 

0  0  5 

Mean 

0 

.0440 

.0674 

.5392 

.7828 

.9770 

0 

0 

.0518 

.0582 

.4584 

.7840 

.9720 

.5 

.0480 

.1830 

.5708 

.7946 

.9832 

0 

0 

.0280 

.1176 

.5034 

.8020 

.9740 

1 

.3728 

.6352 

.6852 

.8206 

.9888 

0 

0 

.1174 

.2912 

.6254 

.8422 

.9824 

1 

.7400 

.9074 

.9270 

.9668 

.9930 

l 

0 

.7392 

.  7454 

. 8602 

.9454 

.9870 

2 

.9982 

.9956 

.9716 

.9736 

.9978 

0 

.9726 

.9752 

.9742 

.9774 

.9976 

1 


FIRST  ENTRY — RECTANGULAR 
SECOND  ENTRY— SPHERICAL 

BASED  ON  5000  REPLICATIONS 
ct  =  .05 
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TABLE  XIV: 

REJECTION  RATES  FOR  INCREASING 

SAMPLE  SIZES 

(BIVARIATE) 

Sample  size 

20 

30 

50 

Shift 

a 

=  .01 

.5 

.0574 

.0860 

.1270 

0 

.0430 

.0564 

.0754 

.5 

.1294 

.2026 

.3652 

.5 

.1230 

.1418 

.2508 

1  .3 

.0126 

.0140 

.0176 

.3  1 

.0136 

.0152 

.0170 

1  0 

.1864 

.2722 

.4522 

0  3 

.1578 

.2244 

.3744 

a. 

=  .05 

.5 

.1710 

.2170 

.2914 

0 

.1388 

.1630 

.2238 

.5 

.3024 

.4144 

.6030 

.5 

.3164 

.3076 

.4826 

1  .3 

.0576 

.0624 

.0728 

.3  1 

.0656 

.0624 

.0760 

1  0 

.3786 

.4884 

.6756 

0  3 

.3342 

.4304 

.6016 

a 

=  .10 

.5 

.2700 

.3228 

.4256 

0 

.2298 

.2658 

.3400 

.5 

.4406 

.5424 

.7190 

.5 

.4534 

.4336 

.6066 

1  .3 

.1178 

.1174 

.1396 

.3  1 

.1258 

.1196 

.1422 

1  0 

.5150 

.6132 

.7800 

0  3 

.  4640 

.5566 

.7160 

BASED  ON  5000 

REPLICATIONS 

FIRST  ENTRY— RECTANGULAR 
SECOND  ENTRY— POLAR 
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TABLE  XV:  REJECTION  RATES  FOR  INCREASING 
SAMPLE  SIZES  (TRI VARIATE) 


Sample  size 

20 

30 

50 

Shift 

a  *  .01 

.5 

.0480 

.0680 

.1036 

0 

.0280 

.0362 

.0526 

0 

.5 

.1738 

.2932 

.5040 

.5 

.0848 

.1662 

.3428 

.5 

1 

0  .3 

.0106 

.0138 

.0148 

0 

1  0 

.0124 

.0134 

.0144 

.3 

0  1 

3 

0  0 

.1606 

.2054 

.3528 

0 

1  0 

.0838 

.1138 

.2080 

0 

0  1 

a  =  .05 

.5 

.1438 

.1974 

.2742 

0 

.1036 

.1256 

.1646 

0 

.5 

.3642 

.5118 

.7268 

.5 

.2198 

.3588 

.5868 

.5 

1 

0  .3 

.0468 

.0588 

.0656 

0 

1  0 

.0512 

.0488 

.0540 

.3 

0  1 

3 

0  0 

.  3438 

.3976 

.5734 

0 

1  0 

.2074 

.2708 

.4126 

0 

0  1 

a  =  .10 

.5 

.2484 

.  3024 

.3876 

0 

0 

.1874 

.2132 

.2650 

.5 

.  4948 

.6396 

.8272 

.5 

.3584 

.4912 

.7040 

.5 

1 

0 

.3 

.0972 

.1142 

.1232 

0 

1 

0 

.1086 

.1030 

.1102 

.3 

0 

1 

3 

0 

0 

.4736 

.5264 

.6880 

0 

1 

0 

.3156 

.3880 

.5450 

0 

0 

1 

BASED  i 

ON 

50 Off REPLICATIONS  FIRST 

ENTRY:  RECTANGULAR 

SECOND  ENTRY :  SPHERICAL 
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APPENDIX  A 


USER  REQUIREMENTS  AND  INPUT  FORMAT  FOR  PROGRAM  FOUTZ 


The  use  of  the  Computer  program  contained  in  Appendix  B 
requires  the  sample  size,  number  of  variates,  applicable 
data  and  the  Multivariate  Normal  distribution  being  tested 
as  described  by  the  mean  vector  and  the  variance-covariance 
matrix.  The  variables  containing  the  required  inputs  as 
well  as  the  required  input  format  are  as  shown  below. 

DESCRIPTION  OF  VARIABLES 


N - Sample  size 

M - Number  of  Variables  (2  or  3) 

SIGMA1 - Variance-Covariance  Matrix 

(MxM) 

Bl - Mean  Vector  (Mxl) 

X - Matrix  of  Sample  Data  (MxN) 

INPUT  FORMAT 

N,M - (215) 

SIGMA1 - (3F12.6)  Input  M  Rows 

Bl - (F12.6)  Input  M  Rows 

X - (3F12.6)  Input  M  Rows 


Input  data  is  echoed  in  the  output  providing  a  check 

for  correct  entry  of  data  as  well  as  is  the  decomposition 

of  SIGMA1.  The  Fn  statistic  as  computed  by  both  methods 

of  blocking  follows  completing  the  output  given  for  a 

« 

single  run.  An  example  run  is  given  for  Trivariate  data 
of  sample  size  10. 
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SAMPLE  TRIVARIATE  RUN 


FOUTZ  TEST  FOR  3  VARIATE  NORMAL 
THE  NUMBER  OF  OBSERVATIONS  =10 


OBSERVATIONS  ENTERED  AS  FOLLOWS 


3.170000 

7.540000 

4.230000 

4.160000 

5.500000 

5.580000 

2.330000 

2.910000 

6.620000 

2.530000 

3.440000 

5.660000 

1.990000 

2.630000 

6.320000 

2.260000 

2.800000 

6.730000 

2.630000 

0.290000 

6.550000 

3.440000 

4.860000 

3.150000 

3.500000 

4.670000 

8.310000 

3.580000 

3.230000 

4.970000 

DISTRIBUTION 

TESTED 

COVARIANCE  MATRIX 

1.000000 

1.000000 

1.000000 

1.000000 

3.000000 

1.000000 

1.000000 

1.000000 

5.000000 

MEAN  VECTOR 

2.000000 

3.000000 

4.000000 

DECOMPOSITION 

OF  SIGMA 

1.000000 

0.0 

0.0 

-0.707107 

0.707107 

0.0 

-0.500000 

0.0 

0.500000 

WITH  POLAR  OR  SPHERICAL  COORDINATES 
FOUTZ  STAT=  0.593289 

WITH  RECTANGULAR  COORDINATES 
FOUTZ  STAT=  0.556877 
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APPENOIX  B 

COMPUTER  PROGRAM  FOUTZ 


C 

c 

c 

c 

c 

c 

c 

c 


c 

r 

t 

c 

c 

c 

c 

c 

c 

c 


990 


5 

10 


c 

c 

c 

8 

c 

c 

c 

c 

c 


30 

992 


******************************* 

*  FORTRAN  COOE  * 

*  FOUTZ  * 

******************************* 


N 

M 

IRAD 

SIGMA1 

Bl 


SAMPLE  SIZE 

DIMENSION  OF  EACH  VECTOR 
N  VECTOR  DESIGNATING  COORDINATE  TO  CUT  ON 
(MtM)COVARIANCE  MATRIX  TEST  DISTRIBUTION 
(  M» 1 ) ME AN  VECTOR 


MAIN  PROGRAM 


PURPOSE: 


READS  IN  N.M  AND  DIMENSIONS 
LIMITED  TO  N»50,M»3  AS  SET 

01  MENS ICN  IRAD(52)»VECT( 50, 6 )  .WKVEC ( 6 ) » BLOCK (51,12), 
SSI GMA 1(3.3) »8 1(3.1 ).X( 50.3 ) , TRAN (3 , 1 )  ,XTT ( 3, 1 ) ,Ci3,3) , 
SBLCC ( 5 1 ,  12  ) ,  X  TTR  (  3  » 1 ) 

REAO( 5, 990 )N»  M 
FORMATi  21 5 ) 

NN»N> 1 
MM»2*M 
NM 1=N—  1 
DO  10  I«1,N,M 
DO  5  J*l,M 
IR AD( J*  I-1)*J 
CONTINUE 
CONTINUE 

CALL  DuRIVE(IRAD»VECT,  WKVEC  f  BLOCK » BLCC  »S  IGMA  l»Bl.NtM» 
SNN^MM.TRANtXTT.C.XTTR.X) 

END 

. SUBROUT INE*DCRIVE . 

PURPOSE: 

ORIVES  PROGRAM  AND  VARIABLE  DIMENSINS  BASED  ON 
M  AND  N.  REACS  IN  Bl,  SIGMA1  AND  DATA  TO  BE 
TESTED.  ECHCS  INPUT  DATA  AND  PRINTS  THE 
RESULTING  FN  STATISTIC. 


SUBROUTINE  OOP  IVE<  iRAOjVECT .WKVEC, BLOCK, BLOC , SIGMA1 , 
$Bi,N,M.NN,MM, TRAN,XTT»C»XTTR ,XJ 
DIMENSION  IRAC(N) ,VECT(N,M),WKVEC(3) ,BL0CK(NN,6) , 
SSIGMAK  M*M)  ,B  1  (M,  1 )  ,  TRAN  (M,  1 )  ,X ( N,M )  , BLOC  (NN  , MM)  , 
SXTT(M,1) ,C(M»M),XTTR(M»1) 

DQ  30  I-l.M 

-  992 ) ( S IGMA1 ( I ,  J  ) , J*1 ,M) 

E 

3F12.6  ) 

•1*M 


CONTINU 
format? 
00  40  I 


48 


993 

40 


70 

CC 


800 

801 

804 

805 

806 

791 

792 


807 

808 

793 


751 

752 


760 

750 


,J-1,M) 


VARIATE 

-  t*  . 


READ(5t  993  IB1<  1*1 1 
F0RMATIF12.6) 

CONTINUE 
DO  70  I*1.N 
READT5»992)(X{I» J) 

CONTINUE 
ECHO  NPUT  DATA 
WRITE  6 » 800 ) M 
WRITE  6  t801 )N 

FORMAT! '1*  ,'FCLTZ  TEST  FOR  *tI2,»  vaiu 
FORMAT ( 'O' » 'THE  NUM8ER  CF  OBSERVATIONS 
FORMAT (  '  S3F12.6) 

FORMAT  (  *0  *  » 'MEAN  VECTOR*  I 
FORMAT ( •  '  *  F 12  *6 1 
WRITE (6,791) 

FORMAT( *0', 'OBSERVATIONS  ENTERED  AS  FOLLOWS' ) 
CO  792  1*1 »N 

WRITE(6,8G4)(X(I,J)«J*1,M) 

WR ITE ( 6 , 807 ) 

WRITE (6 ,808) 

FORMAT! *0* , *D I STR I BUTI CN  TESTED* 

FORMAT ( *0 • , 'COVARIANCE  MATRIX*) 

DO  793  1*1, M 

WRITE(6,804)( S IGMA 1( I , J ) ,J*1,M) 

WRITE (6,805) 

WR  ITE  I  6,806)  (  (  BU  I  ,  J  )  ,  J*1 , 1 )  ,1*1 
CALL  DECOMP (S IGMA1 ,M,C ,0) 

CALL  TRANSFORMATION  ROUTINES 
00  750  1*1, N 


NORMAL*  ) 
13) 


) 


>M) 


00  751  J* 1 • M 
XTTt  J  » l ) *X( I , J ) 
FORMAT!  *  *,3X,F: 


C 

C 


.  ,F12.6) 

CALL  TRANS(M«XTT»B1* TRAN ,C ,  XTTR ) 

DO  760  J*1,M 
VECT( I,J)*TRAN(J,1) 

CONTINUE 

CONTINUE 

CALL  BLOCKS ( V  ECT , N ,NN, M ,MM , I  RAD , BLOCK  ,  WK VEC ) 
CALL  BLCCKR(VECT,N,NN,M,MM, IRAQ, BLOC, WKVEC) 


BLOCK  BY  PCLAR  CR  SPHERICAL  COORDINATES 
CALL  FCUTZ(BLCCK,NN,MM,FN,MI 
WR ITE (6,989) 

989  FORMATt *0* , 'WITH  PCLAR  CR  SPHERICAL  COORDINATES') 
WR ITE ( 6 , 990) FN 

990  FORMATt*  *,'FCUTZ  ST AT*  *,F12.6) 

C  BLOCK  BY  RECTANGULAR  COORDINATES 

CALL  FCUTR (8LCC»NN, MM»FN»M) 

WR  ITE(6 ,988 ) 

FORMATt *0* , 'WITH  RECTANGULAR  COOROIN ATES * ) 

WR  ITE (6 ,99 1 IFN 

FORMATt*  •  ,  *  FCUT  Z  STAT*  »,F12.6) 

RETURN 
ENO 


988 

991 


SUBROUTINE  CECOMP 
PURPOSE : 

DECOMPOSES  THE  COVARIANCE  MATRIX  ENTERED. 
USES  ChCLESKY  DECQMOSITION  VIA  IMSL  ROUTINE 
LUOECP  TO  PROVIDE  A  MATRIX  C  NEEDED  BY  THE 
ROUTINE  TRANS. 


SUBROUTINE  CECCMPt SIGMA, M,C, IV) 

DIMENSION  SIGMAtM,  M)  ,C  (  M  ,M)  ,  At  51 )  ,UL  (51 )  ,  Ll  ( 6  )  ,M  1(6 1 
IJ  *  1 


49 


110 

100 


130 

120 


799 

765 

700 

121 


C 

C 

C 

c 

c 

c 

c 


00  100  I  *  1  ,M 
00  110  J*1,I 
M I J) *S IGMA( I » J) 

IJ*IJ+1 

CONTINUE 

CONTINUE 

CALL  LUDECP(A,UL»M»D1,D2»IER) 

'  ‘  .  »M 

,,M 

I  C T I  » J J  *UL ( III 
I  C( i « J) *1./UL (II) 
IC(I,J)*0.0 


TO  121 
rO.Ll.Ml) 


00  120  I’ 

00  130  J> 

IF ( J • EQ.  1 1 

^ON^fNUE1 
CONTINUE 
IF  ( IV  .  EG  .1  )  GO 
CALL  INVT(C  »M 
MR ITE ( 6  »  799) 

FORMAT ( *0*  » 'DECQMPCS IT ICN  OF  SIGMA*) 
DO  765  1*1. M 

MR  ITE(  6  »  700  )(C(I*J  ) »  J*  1 »  M) 

FORMAT ( *  ' »  3F  12. 6 ) 

CONTINUE 

RETURN 

ENO 


SUBROUTINE  INVT 
PURPOSE 

INVERT  A  MATRIX 


C 

C 

C 


10 

15 


20 


25 


SUBROUTINE  INVT( A , N ,0, L »M) 

Cl  MENS ICN  A<1),L(1),M( 1) 

SEARCH  FOR  LARGEST  ELEMENT 

0*1.0 

NK=-N 

DO  30  K*1 .  N 

NK*NK+N 

L(K)*K 

M( K) *K 

KK*NK+K 

eiGA»A(KK) 

00  20  J-K.N 
IZ*N*I J-l) 

DO  20  I*K,N 
IJ-IZ+I 

IF  i  ABS(BIGA)-  ABS ( A ( I J ) ) )  15,20.20 
BIGA*A( I J) 

L(  K) *  I 
M<K)*J 
CONTINUE 


INTERCHANGE  ROMS 
J*L(K ) 

IF(J-K)  35,35,25 

KI*K-N 

CO  30  1*1, N 

KI*KI«-N 

HOLD*-A(KI ) 

JI-KI-K+J 


50 


non  nno  nnn  ooo  ooo  noon  non 


A(KI  ) 
30  A(JI) 


!  A  (  J  I  ) 
•HCLD 


35 

38 


40 


45 

46 

48 

50 

55 


INTERCHANGE  COLUMNS 
I=M(K) 

IF(I-K)  45,45,38 
JP «N*< I-i) 

DO  40  J*l,N 
JK-NK+J 
JI-JP+J 
H0LD»-A(JK) 

A( JK)*A< JI) 

A(  J I  )  -HOLD 

0IVI0E  COLUMN  BY  MINUS  PIVOT  (VALUE  OF  PIVOT 
ELEMENT  IS  C0NTAINE0  IN  BIGA) 

IF (B IGA )  48,46,48 
0=0.0 
RETURN 
DO  55  1=1, N 
IF(I-K)  50,55,50 
IK*NK+ I 

A(  IK)=A(  IK  > / ( -61 GA ) 

CONTINUE 

REDUCE  MATRIX 


DC  65  1  =  1, N 
IK*NK+I 
HOLD* A ( IK) 

I J  =  I-N 
DO  65  J»1,N 
IJ  =  I  J  +  N 

IF(I-K)  60,65,60 
60  IF(J-K)  62,65,6 2 
62  KJ= I J— I +K 

A<  I J ) =HCLD*A( KJ  )  +  A(  I  J I 
65  CONTINUE 

DIVIDE  ROW  BY  PIVCT 

KJ*K-N 

DO  75  J*1,N 

KJ=KJ+K 

IF(J-K)  70,75,70 
70  A(KJI*A(KJI/8IGA 
75  CONTINUE 

PROOUCT  OF  PIVCTS 

0«0*BIGA 

REPLACE  PIVOT  BY  RECIPROCAL 

A(KK)*1.0/BIGA 
30  CONTINUE 

FINAL  ROW  ANO  COLUMN  INTERCHANGE 

K«N 

100  K-CK-ll 

IF (K )  150,150,105 
105  I«L(K) 

%  IF ( I -K)  120,120,108 
108  JQ«N*(K-I) 


51 


nooonnonn  non  non  onnnnnnnn  nnnonnnnnnn 


HO 

120 

125 


130 

150 


JR=N*(I-1) 

00  110  J«1,N 
JK-JQ+J 
H0LD»A( JK) 

JI *JR+J 
A(  JK  )  *- A  ( J I  ) 

A ( J I )  *HCLD 
J»M<K) 

IF(J-K)  100,100, 125 
KI =K-N 

DO  130  1=1, N 
KI *KI  +  N 
H0LD=A( K I ) 

Jl =KI-K*J 
A (  KI  )  =-  A  (  JI ) 

A(  J I )  *HCLD 
GO  TO  100 
RETURN 
EN0 


SUBROUTINE  TRANS 

PURPOSE:  TO  TRANSFORM  OBSERVATIONS  TO  NI0,I> 

UN0ER  THE  NULL  HYPOTHESIS.  USES  INPUT 
VALUES  OF  B 1  ANC  THE  MATRIX  C  FROM  OECOMP 
TO  TRANSFORM  THE  DATA  ENTERED  USING, 

X  =  C(X-Bl). 

SUBROUTINE  TR ANS ( M , XTT  , B1 .TRAN, C ,XTT R ) 

DIMENSION  B1(M,1J ,XTT(M,  li ,XTTR< M,1J  ,TRAN(M, 1 1  ,C(M,Mi 
CALL  SUBUTT.ei.XTTR.M.ll 
CALL  PRD{C,XTTR,TRAN,M,M,1) 

RETURN 

END 

SUBROUTINE  SUB 
PURPOSE 

SUBTRACT  uNE  MATRIX  FROM  ANOTHER  TO 
FORM  RESULTANT  MATRIX. 


SUBROUTINE  SUE (A ,B ,R ,N,M > 
DIMENSION  All  I  ,8< 1) ,R< 1 ) 

CALCULATE  NUMBER  OF  ELEMENTS 

NM=N*M 

SUBTRACT  MATRICES 

00  10  I  * 1 , NM 
10  R( I)  =  A( I )  — B ( I  ) 

RETURN 

ENO 


SUBROUTINE  PRO 
PURPOSE 

MULTIPLY  TWO  MATRICES  TO  FORM  A 
RESULTANT  MATRIX. 
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nnnooonnnnno  o  an 


SUBROUTINE  PRC  (A  ♦  B  ,  R  ,N  .  M  ,  L  ) 
DIMENSION  A ( I J »8( 1 ) »R( II 


IK=-M 

DO  10  K»1,L 
IK  =1 K  +  M 
DO  10  J  *  1  »N 
IR*I  R+l 
J I *J-N 
IB  =  IK 
R ( IRI =0 
00  10  I  =  1 ,  M 
JI=JI+N 
IB  =  IB+1 

10  R(IR)-R(IR)+A(JI)*8(  IB) 
RETURN 
EN0 


SUBROUTINE  BLOCKS 

PURPOSE : 

THIS  SUBROUTINE  TAKES  N  M-VARI ATE  VECTORS  ANO  PARTITIONS 
A  SPACE  OF  DIMENSION  M  INTO  N+l  STATISTICALLY  EQUIVALENT 
BLOCKS  BY  RECORDING  BLOCK  COORDINATE  RANGES  IN  A  MATRIX 
BLOCK  BY  THE  USE  OF  SPHERICAL  OR  PCLAR  COCRDI NATESAS 
AS  CUTTING  FUNCTIONS.  THE  CUTTING  COORDINATE  USED  AT 
EACH  STEP  IS  CONTAINED  IN  A  VECTOR  IRAD. 


SUBROUT INE  BLOCKS ( VECT , N  ,NN , M f MM  ,  IRAC  , BLOCK, WKVEC I 
DI MENS  ION  VECT (N,M ) , BLOCKINN ,61, IRAD ( N) , WKVEC (6) 
ZL*1. OE-8 
BLCCKI I, 11=0. a 
eLCCKd,  21*1000. 

BLOCK (1,3) =0. C 
8LCCK ( 1 , 4 ) *6. 2831853 
BLOCK ( 1,51*0.0 
BLOCK! 1  ,6) *3. 1415927 
00  100  J  =  1  »N 
TE  MP*0. 0 
DO  110  1*1, M 

110  TEMP=TEMP+VECT(J , I  )**2 
RA0*TEMP**.5 

IF (RAD. GT . ZL) GO  TO  112 
TDEG*6. 2831853 
P0EG*3.  1415927 
GO  TO  111 

112  TARG«VECT( J,l )/( ( VEC T( J , 1 ) **2  +  VECT< J , 2)**2)**  .  51 
PARG*VECT( J, MI/RAD 

IF(TARG.LT.-1  .  )TARG»-1 . 

IF(TARG.LT.l. ) GO  TC  1122 
TARG* 1.0 

IF  (PARG.LT.-l  .  JPARG—l. 

1122  IFIPARG.LT. l.OIGO  TO  1123 
PARG*1.0 

1123  DE G*ACOS ( TARG ) 

IF(VECT(J,2).GT.O. JGO  TO  111 
IF (D EG. LT. 1.57 0796 3) GO  TO  113 
DEG-OEG+1. 5707963 

GO  TO  111 

113  DEG«0EG+4. 712389 

111  CONTINUE 

PO  EG*  AC  C  S  ( P  AR  G  ) 

WKVEC ( 1 ) *T  EMP 
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c. 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c. 

c 


85 

86 

100 


300 


C. 

C 

c 

c 

c 

c 

c 

c 


II 

>  2  )  )GQ 

TO 

120 

I 

•1))G0 

TO 

120 

I, 

t  3 ) ) GO 

TO 

120 

I, 

i  4 ) ) GO 

TO 

120 

I 

t  5 ) ) GO 

TO 

120 

I. 

r  6  ) )  GO 

TO 

120 

hKVEC  ( 2  )*DEG 
WK  VEC ( 3 ) *P0EG 
00  120  1=1. NN 


IF(M.EQ.2IGQ  TC  119 


119  CONTINUE 
I  BLOCK*  I 
GO  TO  150 

120  CONTINUE 
150  JJ*IRAD(J) 

BL  IM=  l«K  VEC  (  J  J  ) 

00  160  1= 1 ,MM 

160  BLOCK ( J+l »  I )  =  E  LOCK ( I  BLOCK. I  ; 
BLOCK ( I  BLOCK. 2*JJ) =BLIM 
BLOCK ( J+1,2*J J-l )=8LIM 
100  CONTINUE 
RETURN 
ENO 


SUBROUTINE  FCUTZ 

PURPOSES  TO  COMPUTE  THE  F0UT2  STATISTIC  FROM  THE 
BLOCKS  DETERMINED  BY  SUBROUTINE  BLOCKS 
METHOD  USES  IMSL  ROUTINE  MDCh  TO  EVALUATE 
CHI— SCUARE  PROBABILITIES  TO  EVALUATE  THE 
CLOSED  FCRM  EXPRESSION  GIVEN  FOR  D.  THE  FN 
STATISTIC  IS  GENERATED  BY  FCUTZ'S  CLOSED 
COMPUTATIONAL  FORMULA. 

SUBROUT  INE  FOUTZ ( BLOCK ,NN, MM, FN, M> 

DIMENSION  BLOCK! NN,6),P(51J 
CF=FLOAT ( M ) 

TP=0. 0 

00  100  1*1,  NN 

CALL  MDCMBLOCKI  1,1)  »DF,P1»IER) 

CALL  MDCH(BLOCK( 1 ,21 ,0F,P2, IERJ 
P3=P  2-P  1 

P4=( BLOCK (1, 4  I -BLOCK (1, 3)1/6. 283 1853 
IF (M. ED . 2 ) GO  TC  85 

P5  =  (COS (BLOCK (  1,5) )-C0  S ( BLOCK ( 1,6)1) /2.0 
GO  TO  86 
P5=l. 0 

P(  I  )  =  P3*P4*P5 
TP*TP+P( I) 

CONTINUE 
FN=0 .0 

DO  300  1=1, NN 
AM AX= 1 . 0/NN— P ( I ) 

IF  ( AMAX.LT.0.)G0  TO  300 

FN*FN+A  MAX 

CONTINUE 

RETURN 

END 

. SUBROUTINE *BLOCKR . 

PURPOSE  s 

THIS  SUBROUTINE  TAKES  N  M-VARI ATE  VECTORS  AND  PARTITIONS 
A  SPACE  OF  C IMENSION  M  INTO  N+l  STATISTICALLY  EQUIVALENT 
BLCCKS  BY  RECCRCING  BLOCK  COORDINATE  RANGES  IN  A  MATRIX 
BLOCK  BY  THE  USE  OF  RECTANGULAR  COORDINATES 


54 


AS  CUTTING  FUNCTIONS.  THE  CUTTING  COORDINATE  USED  AT 
EACH  STEP  IS  CONTAINED  IN  A  VECTOR  IRAQ. 

SUBROUT  INE  BLCCKR ( VECT  »N »NN  »M  »MM *  I RAD  .BLOCK*  WKVEC ) 
DIMENSION  VECT(N»M)»BLOCK(NN»MM)»IRAD(N)»  MKVEC (M ) 

DO  10  I  *  1 , MM, 2 

BLOCK ( 1 , I ) *-1000. 

BLOCK (1,1+1 )* 1000  . 

CONTINUE 
DO  100  J  =  1,N 
DO  110  1*1,  M 

WKVEC(I)=VECT(J»IJ 
DO  120  1*1 ,MN 

DO  13  C  11  =  1. M 

IF(WKVEC( II). LT. BLOCK!  1,2*11-11  >G0  TO  120 
IF! WKVEC! 1 1  J.GT .BLOCK! 1.2*11) )G0  TO  120 
CONTINUE 
IBLOCK=I 
GO  TO  150 
CONT  INUE 
JJ*IRAD< J) 

8L I M*HKVEC ( J  J ) 

00  160  1  =  1. MM 

BLOCK !  J+l  ,  I ) =BLCCK( I  BLOCK, I) 

CONTINUE 

8L0CK! I8LOCK,2*JJ)»BLIM 
BLOCK! J+l, 2*JJ-1) »BLIM 
CONTINUE 
RETURN 
END 

. SUBRCUTiNE'FOUTR . 

PURPOSE: 

TO  COMPUTE  THE  FOUTZ  STATISTIC  FROM  THE 
BLOCKS  DETERMINED  BY  SUBROUTINE  BLOCKR 
METHCC  USES  IMSL  ROUTINE  MONCR  TO  EVALUATE 
NORMAL  PROBABILITIES  TO  EVALUATE  THE 
CLOSED  FORM  EXPRESSION  GIVEN  FOR  D.  THE  FN 
STATISTIC  IS  GENERATED  BY  FCUTZ'S  CLOSED 
COMPUTATIONAL  FORMULA. 


SUBROUTINE  FOUTR ! BLOCK , NN, MM ,FN ) 
DIMENSION  BLOCK! NN , MM) , P  (51  ) 

00  100  1*1, NN 

P(IJ=1.0 

DO  200  J=1 ,MM  ,  2 

CALL  M0NCR(8LCCK( I  ,J  )  ,P1J 

CALL  MD NO R ( BLOCK ( I » J+l ) , P2 ) 

P3-A8S! P2-P1) 

P(  I)  =  P(  I  )*P3 

IF(J.NE.MM-1)GC  TO  200 

CONTINUE 

CONTINUE 

FN*0. 0 

CO  300  1=1, NN 

AMAX*1 .O/NN-P ( I ) 

IFUMAX.LE.O.OGO  TO  300 

FN«FN+AMAX 

CONTINUE 

RETURN 

END 
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